1/30 



FIG. 1 




i 



2/30 




3/30 

FIG. 3 



10 



MICRO- 
PHONE 



16 



CCD 



17 



TOUCH 
SENSOR 



CONTROLLER 
31- 



SENSOR INPUT PROCESSOR 



SPEECH 
RECOGNI- 
TION 
UNIT 



T 



31A 



IMAGE 
RECOGNI- 
TION 
UNIT 



PRESSURE 
RECOGNI- 
TION UNIT 



-31B 



^31C 



EMOTION/ 
INSTINCT 
MODEL UNIT 



-32 



33- 
34- 

35- 



1_£ 



CONVERSATION 
PROCESSOR 



ACTION 
DETERMIN- 
ING UNIT 



-38 



POSTURE 
SHIFTING 
UNIT 



SPEECH 




ACOUSTIC 


SYNTHE- 




PROCES- 


SIZER 




SOR 


/ 




36 


37 



CONTROL 
UNIT 



ACTUATOR 
3AA-) 



ACTUATOR 
5Ai 



ACTUATOR 
5A 2 



4/30 

FIG. 4 



53 
.1- 



FEATURE 
BUFFER 



SPEECH INPUT 



51 



A/D 




CONVERTER 


52 




FEATURE 


EXTRACTION 


UNIT 




54 

) > 




MATCHING 


UNIT 





CONVERSATION 

MANAGEMENT 

INFORMATION 



ACOUSTIC 

MODEL 

DATABASE 



DICTIONARY 
DATABASE 



GRAMMAR 
DATABASE 



RECOGNITION 

RESULT 

(TEXT) 



31A 



5/30 



FIG. 5 



77 



PRESENT 

TOPIC 

MEMORY 



RECOGNITION 
RESULT 



71 

1_ 



LANGUAGE 
PROCESSOR 



74 

1_ 



TOPIC 
MANAGER 



78 



DICTIONARY 
DATABASE 



ANALYZING 
GRAMMAR 
DATABASE 



CONVERSATION 

HISTORY 

MEMORY 



CONVER- 
SATION 
GENERATOR 



TOPIC 
MEMORY 



DICTIONARY 
DATABASE 



CONVERSATION- 
GENERATION 
RULE DATABASE 



-72 



-73 



-75 



-76 



-79 



-80 



TEXT OUTPUT 



38 



6/30 

FIG. 6 



TEXT INPUT 
91 



TEXT 

ANALYZER 



94 



RULED 




SPEECH 


SYNTHESIZER 


96 




D/A 




CONVERTER 



DICTIONARY 
DATABASE 



ANALYZING 
GRAMMAR 
DATABASE 



PHONEME 
DATABASE 



SPEECH OUTPUT 



103 



7/30 



FIG. 7A 



SERVER ~-~101 



1 ROBOT 



CONVERSATION 



FIG. 7B 



SERVER ---101 



102 



INTERNET 



COMMUNICATION 
DEVICE 



ROBOT 



CONVERSATION 



8/30 

FIG. 8 



110 



in- 



TOPIC DATABASE 



PROFILE 
MEMORY 



3; 



(112A 



FILTER 



-101 



DOWNLOAD 



121 



76 



COMMUNICATION 
UNIT 



PROFILE 
MEMORY 



TOPIC 
MEMORY 



10B 



-19 



123 



PROFILE 
CREATOR 



38 



CONVERSATION 
PROCESSOR 



10 



9/30 

FIG. 9 



110 



TOPIC DATABASE 



DOWNLOAD 



COMMUNICATION 
UNIT 



121 



PROFILE 
MEMORY 



76 



TOPIC 
MEMORY 



10B 



FILTER 



-11 2B 



123 



PROFILE 
CREATOR 



38 



CONVERSATION 
PROCESSOR 



10 



10/30 



FIG. 10 



ROBOT 1 



USER 



THERE WAS AN ACCIDENT 
AT NARITA YESTERDAY. 



74 



WHEN 


: 0.5 


WHERE 


: 0.5 


WHO : 


0.5 


WHAT 


0.5 


WHY : 


0.5 



7 



WHEN 


0.0 


WHERE 


: 0.0 


WHO : 


0.0 


WHAT : 


0.0 


WHY : 


0.0 



7 



t2 ( HUH? ) 



THERE WAS AN ACCIDENT 
AT NARITA YESTERDAY. 



74 



U (^UH-HUH ^ 



WHEN 


0.5 


WHERE 


: 0.5 


WHO : 


0.5 


WHAT 


0.5 


WHY : 


0.5 



T 

41 



WHEN 


0.2 


WHERE 


: 0.2 


WHO : 


0.0 


WHAT 


0.2 


WHY : 


0.0 



7 



11/30 



FIG. 11 



ROBOT 1 



74 



USER 



^ AT WHAT TIME? ^ 



WHEN 


: 0.5 


WHERE 


: 0.5 


WHO : 


0.5 


WHAT 


0.5 


WHY : 


0.5 



T 

41 



WHEN 


0.4 


WHERE 


: 0.2 


WHO : 


0.0 


WHAT 


0.2 


WHY : 


0.0 



7 



12/30 



FIG. 12 



ROBOT 1 


USER 




tl 




( THERE WAS AN ACCIDENT 


74 


^ AT NARITA . 


1 





WHEN 


0.5 


WHERE 


: 0.8 


WHO : 


0.0 


WHAT : 


0.1 


WHY : 


0.0 



T 

141 



WHEN 


0.0 


WHERE 


: 0.8 


WHO : 


0.0 


WHAT 


0.1 


WHY : 


0.0 



7 



f\/VHEN?J 



74 | ( YESTERDAYJ 



WHEN 


0.2 


WHERE 


: 0.8 


WHO : 


0.0 


WHAT : 


0.1 


WHY : 


0.0 



7 

41 



WHEN 


0.2 


WHERE 


: 0.8 


WHO : 


0.0 


WHAT : 


0.1 


WHY : 


0.0 



T 

42 



13/30 



FIG. 13 



ROBOT 1 



AT WHAT TIME? 



74 



USER 



t5 



AFTER EIGHT 
O'CLOCK 
AT NIGHT 



WHEN : 0.6 




WHEN : 0.6 


WHERE : 0.8 




WHERE : 0.8 


WHO : 0.0 




WHO : 0.0 


WHAT : 0.1 




WHAT : 0.1 


WHY : 0.0 




WHY : 0.0 


/ 

141 


/ 

142 



14/30 



FIG. 14 



START ^) 



CONVERSATION BEGINS S1 



CREATE FRAMES S2 



COMPUTE AVERAGE VALUE 



S3 



S4 

^WANT TO CHANGE^ ^ YES 
.TOPIC? 



NO 



RESET VALUES FOR 
ITEMS IN FRAMES 



S5 



15/30 



FIG. 15 




AVERAGE VALUE 



16/30 




17/30 




18/30 



FIG. 18 



76 



INFORMATION 



SUBJECT : BUS ACCIDENT 
WHEN : FEBRUARY 10 
WHERE : SAPPORO 
WHO : 10 PASSENGERS 
WHAT : INJURED 
WHY : SKIDDING ACCIDENT 



SUBJECT : AIRPLANE 
ACCIDENT 
WHEN : FEBRUARY 10 
WHERE : INDIA 
WHO : 100 PASSENGERS 
WHAT : INJURED 
WHY : UNKNOWN 



SUBJECT : SNOW FESTIVAL 
WHEN : FEBRUARY 5 TO 

10 EVERY YEAR 
WHERE : SAPPORO 
WHO : ONE MILLION 

SPECTATORS 
WHAT : ENJOY 
WHY : - 



SUBJECT : NUCLEAR 
ACCIDENT 
WHEN : SEPTEMBER 25 
WHERE : TOKAIMURA 
WHO : 20 VILLAGE 

INHABITANTS 
WHAT : EXPOSED TO 

RADIATION 
WHY : LEAKAGE OF 

RADIATION 



19/30 



FIG. 19 



INFORMATION 



SUBJECT : BUS ACCIDENT 
WHEN : FEBRUARY 10 
WHERE : SAPPORO 
WHO : 10 PASSENGERS 
WHAT : INJURED 
WHY : SKIDDING ACCIDENT 



ATTRIBUTE 
(KEY WORD) 



BUS, ACCIDENT, FEBRUARY, 
10TH, SAPPPORO, 
PASSENGER, 10 PEOPLE, 
INJURY, 

SKIDDING ACCIDENT 



SUBJECT : SNOW FESTIVAL 
WHEN : FEBRUARY 5 TO 
10 EVERY YEAR 
WHERE : SAPPORO 
WHO : ONE MILLION 
SPECTATORS 
WHAT : ENJOY 
WHY : - 



SNOW FESTIVAL, FEBRUARY, 
5TH TO 10TH, SPECTACLE, 
ONE MILLION PEOPLE, 
ENJOY 



SUBJECT : AIRPLANE 
ACCIDENT 
WHEN : FEBRUALY 10 
WHERE : INDIA 
WHO : 100 PASSENGERS 
WHAT : INJURED 
WHY : UNKNOWN 



AIRPLANE, ACCIDENT, 
FEBRUARY, 10TH, 
INDIA, PASSENGER, 
100 PEOPLE, INJURY 



SUBJECT : NUCLEAR 
ACCIDENT 
WHEN : SEPTEMBER 25 
WHERE : TOKAIMURA 
WHO : 20 VILLAGE 

INHABITANTS 
WHAT : EXPOSED 

TO RADIATION 
WHY : LEAKAGE OF 

RADIATION 



NUCLEAR ACCIDENT, 
SEPTEMBER, 25TH, 
TOKAIMURA, 
VILLAGE INHABITANT, 
20 PEOPLE, 

EXPOSURE TO RADIATION, 
LEAKAGE OF RADIATION 



20/30 



FIG. 20 



Q START ^ 




COMPUTE DEGREE OF 
ASSOCIATION BETWEEN 
PRESENT TOPIC AND EACH 
OF THE OTHER TOPICS 








SELECT TOPIC WITH 
HIGHEST DEGREE OF 
ASSOCIATION 








CHANGE TOPIC 








UPDATE PROCESSING 
OF DEGREE OF 
ASSOCIATION TABLE 





Q END ^ 



21/30 



C\J 

CD 



22/30 



FIG. 22 



Q START ) 




CREATE PAIRS OF 
KEYWORDS BETWEEN 
TOPIC T-1 AND 
PREVIOUS TOPIC T-2 



UPDATE DEGREE OF 
ASSOCIATION TABLE 



( return) 



23/30 



FIG. 23 

( START J 




COMPUTE DEGREE OF 
ASSOCIATION BETWEEN 
SELECTED TOPIC AND 
PRESENT TOPIC 



S33 



NO 



S34 



THRESHOLD 
.EXCEEDED?^ 



YES 



S35 



YES ^ HAS SELECTED TOPIC - 

^BEEN BROUGHT UP 

RECENTLY? 




24/30 




25/30 



FIG. 25 



START 



S41 



IS USER'S TOPIC 
ASSOCIATED WITH 
"PRESENT TOPIC? 



YES 



S46 > 




CHANGE 


TO 




"UNKNOWN" TOPIC 






CHANGE TO 
RETRIEVED TOPIC 



( END } 



26/30 



FIG. 26 



( START } 



INPUT NE 


W TOPIC 




1 


EXTRACT KEYWORDS 
FROM TOPIC 






GENERATE ALL PAIRS 
OF KEYWORDS 






UPDATE Dt 
ASSOCIATK 


EGREE OF 
DN TABLE 



( END ^ 



27/30 



FIG. 27 

Q START ) 



S62 



<CIS TOPIC ( 


CHANGED? ^> 

NO 


ROBOT VOLUNTARILY S63 
CHANGES TOPIC 









( END } 



TRACK PROCESSING 
OF CHANGE OF TOPIC 
BY USER 



S61 



28/30 

FIG. 28 



INFORMATION 



SUBJECT : BUS ACCIDENT 
WHEN : FEBRUARY 10 
WHERE : SAPPORO 
WHO : 10 PASSENGERS 
WHAT : INJURED 
WHY : SKIDDING ACCIDENT 



CATEGORY 



ACCIDENT 
NEWS 



SUBJECT : SNOW FESTIVAL 
WHEN : FEBRUARY 5 TO 

10 EVERY YEAR 
WHERE : SAPPORO 
WHO : ONE MILLION 

SPECTATORS 
WHAT : ENJOY 
WHY : - 



SUBJECT : AIRPLANE 
ACCIDENT 
WHEN : FEBRUARY 10 
WHERE : INDIA 
WHO : 100 PASSENGERS 
WHAT : INJURED 
WHY : UNKNOWN 



SUBJECT : NUCLEAR 
ACCIDENT 
WHEN : SEPTEMBER 25 
WHERE : TOKAIMURA 
WHO : 20 VILLAGE 

INHABITANTS 
WHAT : EXPOSED 

TO RADIATION 
WHY : LEAKAGE OF 

RADIATION 



SEASONAL 
INFORMATION 



ACCIDENT 
NEWS 



ACCIDENT 
NEWS 



ATTRIBUTE 



PLACE 



SAPPORO, 
ROAD 



SAPPORO 



INDIA 



TOKAIMURA 
NUCLEAR 
POWER 
GENERATION 
FACILITY 



TIME 



FEBRUARY 10 



FEBRUARY 5 
TO 10 



FEBRUARY 10 



SEPTEMBER 25 



29/30 



o 
i — 
o 



■11-4- 



O 

o 

CCD 



CD 
CM 

CD 



5> CL 

o cq 



LUO 



o 

i 

Q 



Q 
O 
O 

o 



o 
o 



§1 

o = 



EC ^, LU 
Ll_ _ CO 



30/30 



FIG. 30 



201 


202 


203 


CPU 




ROM 




RAM 




-205 



-210 



211 ) 213 
212 214 



